-
Notifications
You must be signed in to change notification settings - Fork 17
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CH-384] add filecache and link jemalloc in the same order as CH #386
base: clickhouse_backend
Are you sure you want to change the base?
[CH-384] add filecache and link jemalloc in the same order as CH #386
Conversation
Backport ClickHouse#35755 to 22.3: Fix bug in conversion from custom types to string
Backport ClickHouse#35815 to 22.3: Fix cgroups cores detection
Backport ClickHouse#35770 to 22.3: Fix enable LLVM for JIT compilation in CMake
Refactor releasing process
Simplify strip for new packages
…l_flag Resurrect build hash
…ash_v2 One more try to resurrect build hash
New package clickhouse-keeper
Docker release and regular builds
Fix automatic bucket prefix for master
support xxhash64/hash
Fully support from_unixtime and arrayJoin
Upgrade substrait proto by velox Co-authored-by: shuai.li <[email protected]>
Co-authored-by: shuai.li <[email protected]>
Support functions position/locate
…House#354) ShuffleSplitter improvement: support multiple subdirs
Support full join with join condition Co-authored-by: shuai.li <[email protected]>
Can one of the admins verify this patch? |
String region_name; | ||
const char * amazon_suffix = ".amazonaws.com"; | ||
const char * amazon_prefix = "https://s3."; | ||
if (endpoint.find(amazon_suffix) != std::string::npos) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这个逻辑可能不适用于aws cn
@@ -165,7 +234,7 @@ void registerReadBufferBuildes(ReadBufferBuilderFactory & factory) | |||
factory.registerBuilder("hdfs", [](DB::ContextPtr context_) { return std::make_shared<HDFSFileReadBufferBuilder>(context_); }); | |||
|
|||
#if USE_AWS_S3 | |||
factory.registerBuilder("s3", [](DB::ContextPtr context_) { return std::make_shared<S3FileReadBufferBuilder>(context_); }); | |||
factory.registerBuilder("s3a", [](DB::ContextPtr context_) { return std::make_shared<S3FileReadBufferBuilder>(context_); }); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这里是不是可以同时支持s3和s3a
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
可以 但是因为spark上层好像只认s3a 不认s3 ,所以这里加了以后,相当于没有测试到
@@ -165,7 +234,7 @@ void registerReadBufferBuildes(ReadBufferBuilderFactory & factory) | |||
factory.registerBuilder("hdfs", [](DB::ContextPtr context_) { return std::make_shared<HDFSFileReadBufferBuilder>(context_); }); | |||
|
|||
#if USE_AWS_S3 | |||
factory.registerBuilder("s3", [](DB::ContextPtr context_) { return std::make_shared<S3FileReadBufferBuilder>(context_); }); | |||
factory.registerBuilder("s3a", [](DB::ContextPtr context_) { return std::make_shared<S3FileReadBufferBuilder>(context_); }); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这里是不是可以同时支持s3和s3a
…AD, and set ENABLE_JEMALLLOC=OFF,and JEMALLOC_ATTR(constructor(101)) in jemallo.c)
…le PRELOAD, and set ENABLE_JEMALLLOC=OFF,and JEMALLOC_ATTR(constructor(101)) in jemallo.c)" This reverts commit f242fcc.
d5905eb
to
21d5919
Compare
6528ff0
to
52be833
Compare
dc60d55
to
8066113
Compare
Changelog category (leave one):
Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
...
Documentation entry for user-facing changes